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Abstract 

We prove that there are 0/1 polytopes P C R" that do not admit 
a compact LP formulation. More precisely we show that for every n 
there is a sets X C {0, 1}™ such that conv(A) must have extension 
complexity at least 2™/ 2 '' 1 ~°W. In other words, every polyhedron Q 
that can be linearly projected on conv(A) must have exponentially 
many facets. 

In fact, the same result also applies if conv(X) is restricted to be a 
matroid polytope. 

Conditioning on NP ^ P/ po iyi our result rules out the existence of 
any compact formulation for the TSP polytope, even if the formulation 
may contain arbitrary real numbers. 



1 Introduction 

Combinatorial optimization deals with finding the best solution out of a 
finite number of choices X C {0, l} n , e.g. finding the cheapest spanning 
tree in a graph. If possible one aims of course to design a polynomial time 
algorithm. However another popular way to study combinatorial problems 
is to express the convex hull P = conv(X) by linear inequalities Ax < b, i.e. 
describing them as the solutions of a linear program. A drawback of this 
approach is that in general an exponential number of inequalities is needed. 
In principle one could use the Ellipsoid method to optimize these systems, 
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if at least the separation problem can be solved in polynomial time. But in 
practice this method is considered to be not applicable. A more satisfactory 
approach is to allow polynomially many extra variables in order to reduce the 
number of necessary inequalities to a polynomial. This is called a compact 
formulation P = {x \ By : Ax + Uy < b}. Such compact formulations exist 
for example for the spanning tree polytope |Mar91| . the parity polytope and 
the permutahedron (see [Sch03j for an extensive account). 

The advantages of such a compact formulation are that (1) one can now 
optimize any linear function over X in polynomial time; (2) one can solve 
the problem with a powerful general purpose LP solver, without the need to 
implement a custom-tailored algorithm. 

This naturally leads to the question for which problems such a com- 
pact formulation does not exist. Yannakakis [Yan91] showed that the TSP 
polytope -Ptsp (the convex full of the characteristic vectors of all Hamilto- 
nian cycles in the complete graph on n nodes) does not have a subexponen- 
tial size symmetric formulation. Surprisingly the same result holds true for 
the matching polytope, though here a complete description of all facets is 
known due to Edmonds |Edm65j and the problem itself as well as the sep- 
aration problem are solvable in polynomial time. Kaibel, Pashkovich and 
Theis [KPTlOj demonstrate that symmetric formulations are in some cases 
more restricted by proving that there is a compact non-symmetric formula- 
tion for all logn-size matchings, while symmetric formulations still need size 

n O(logn)_ 

However, it remains a fundamental open problem to show that the match- 
ing polytope or the TSP polytope do not admit any non-symmetric compact 
formulation. In fact, it was even an open problem to prove that there exists 
any family of 0/1 polytopes without a compact formulation^. In this paper 
we answer this question affirmatively 

Our idea is based on a counting argument similar to Shannon's the- 
orem |Sha49j (see also [AB09]) for lower bounds on circuit sizes: Let us 
assume for the sake of contradiction that all n-dimensional 0/1 polytopes 
have a compact formulation P = {x \ By > : Ax + Uy = b} of polynomial 
size r(n). Since there are doubly-exponentially many 0/1 polytopes, there 
must also be at least that many formulations of size r(n). This would lead to 
a contradiction under the additional assumption that all coefficients in the 
system Ax + Uy = b have polynomial encoding length. Unfortunately there 
is no known result which guarantees that the coefficients of U will even be 

1 This was posed as an open problem by Volker Kaibel on the 1st Cargese Workshop 
in Combinatorial Optimization. 
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rational and already a single real number can contain an infinite amount of 
information!] ruling out a simple counting argument. 

Our contribution 

In our approach, we bypass these difficulties by selecting a linearly indepen- 
dent subsystem of Ax + Uy = b which maximizes the volume of the spanned 
parallelepiped; then we discretize the entries of U. We thus obtain a sub- 
system Ax + Uy = b with the property that x S X if and only if there is 
a short certificate y such that Ax + Uy ~ b for the rounded system. Sec- 
ondly, all numbers in A,U,b have an encoding length which is bounded by a 
polynomial in n. In other words, this construction defines an injective map, 
taking a set X as input and providing (A,U,b). Since there are doubly- 
exponentially many sets X C {0, l} n and by injectivity, the number of such 
systems (A, U, b) must also be doubly-exponential, which then implies the 
result. 

It is folklore, that if NP problems do not all have polynomial size circuits, 
then the TSP polytope does not admit a compact formulation in which the 
numbers are rationals with polynomial encoding length. We can argue that 
the latter condition can be omitted. 

2 Related work 

A formulation of size 0{n log n) for the permutahedron was provided by Goe- 
mans [GoelOj. In fact, |GoelO) also showed that this is tight up to constant 
factors. The lower bound of |GoelO| is based on the insight that the num- 
ber of facets of any extension must be at least logarithmic in the number 
of vertices of the target polytope (which is n! for the permutahedron). The 
perfect matching polytope for planar graphs and graphs with bounded genus 
does admit a compact formulation [Bar93, Ger91j. A useful tool to design 
such formulations is the Theorem of Balas |Bal85, Bal98j, which describes 
the convex hull of the union of polyhedra. For NP-hard problems, one can 
of course not expect the existence of any exact compact formulation. Nev- 
ertheless, Bienstock |Bie08| gave an approximate formulation of size n ' 1 ^' 
for the Knapsack polytope. This means, optimizing any linear function over 
the approximate polytope will give the optimum Knapsack value, up to a 

2 Note that the usual argument that a polytope with rational vertices admits rational 
inequalities and vice versa does not apply, since both, the vertices and the inequalities of 
the extension polyhedron might be irrational. 
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1 + e factor. For a more detailed literature review, we refer to the surveys 
of Conforti, Cornuejols and Zambelli [CCZ10J and of Kaibel [Kaill] , 

3 Preliminaries 

Let P C M. n be a polytope with non-redundant inequality representation 
P = {x G M n | Ax < b}. An extension is a polyhedron Q C M m together 
with a linear projection p : W 71 — > W 1 such that p(Q) = P. An extended 
formulation is a description of Q with linear inequalities and equations Q = 
{z G IR m | Cz < c, -Dz = d} (together with p). The size of the extended 
formulation is the number of inequalities in the description, i.e. the number 
of rows in C. We do not need to account for the number of equations, since 
they can always be eliminated. Now we can define the extension complexity 
xc(P) as the smallest size of any extended formulation (see |Kaill| for more 
details) . 

Let X = {xi, . . . ,x v } C P be the vertices (or extreme points) of P and 
let f be the number of inequalities in the description P = {x G M. n \ Ax < b}. 
Then the slack-matrix S G of P is defined by S%j = b{ — AiXj. Recall 

that the rank of a matrix S is the smallest r such that one can factor S = UV, 
where U is a matrix with r columns and V is a matrix with r rows. A 
notion which is very important for studying extended formulations is the 
non-negative rank of a matrix: 

rk+(5) = min{r | 3U G Mg r , V G : S = UV} 

Note that given a matrix A C Q™ xn , deciding whether rk(A) = rk + (A) is 
NP-hard [Vav09j. A basic theorem concerning extended formulations, is the 
insight of Yannakakis, that the non-negative factorization of the slack-matrix 
with minimum r gives the smallest extension: 

Theorem 1 (Yannakakis |Yan91J). Let P be a polytope with vertices X = 
{x\, . . . ,x v }, non-redundant inequality description P = {x G R n | Ax < b} 
and corresponding slack matrix S. Then xc(P) = rk+(S). Moreover, for any 
factorization S = UV with U, V > one can write P = {x G W 1 \ By > : 
Ax + Uy = b} and for every Xj G X one has Axj + U ■ V 3 = b. 

In other words: Given a polytope P = {x G W 1 \ Ax < 6}, the smallest 
extension can be found by factoring the slack matrix S into non-negative 
factors U and V with minimum number of columns/rows. Then the smallest 
extended formulation comprises of Q = {(x,y) G M n x IR XC ( P ) | Ax + Uy = 
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b, y > 0} together with the projection on the x-variables proj x (Q) = {x G 
M n | 3y : (x,y) G Q}. While for a polytope P, the inequality description 
Ax < b is not unique, Theorem Q] implies that the non-negative rank is the 
same for all these descriptions. 

For any matrix A, we denote its ith. row by Ai and the ith column by A 1 . 
For linearly independent vectors wi, . . . , Wk 6 M n , we define vol(wi, . . . , Wk) 
as the A;- dimensional volume of the parallelepiped, spanned by w\, . . . ,Wk- 
Hence for k = n one has vol(u>i, . . . ,Wk) = | det(P)| where B is a matrix, 
having Wi, . . . , W}~ as column vectors in an arbitrary order. Note that for any 
vector w G span{w\, ... ,Wk), there are unique coefficients A G M. k such that 
w = X)i=i ^i w i an( i ^ Cramer's rule 

_ V01(W1, ■ ■ ■ , Wi-l, W, Wj+l, . . . , w k ) 

vol(wi,...,w k ) 

For gGK, let <7Z>o = {0, g, 2g, . . .} denote all non- negative integer multiples 
of q. 

4 A lower bound for general 0/1 polytopes 

In the following we fix a set X C {0,1}™. It is well known, that one can 
choose a matrix A and a vector b with integral entries such that P = {x G 
M n | < 6} = conv(X), while the absolute values of any entry in A and 
b are bounded by A := A(n) := {^/n~+l) n+l < 2 nl °^ (see e.g. Cor. 26 
in [ZleOOjy Let S be the corresponding slack-matrix, then S is non- negative 
by definition and integral, since A, b and all vertices are integral. More 
precisely Sij = bj — AiXj G {0, . . . , (n + 1)A}. Let S = UV be any non- 
negative factorization, i.e. U G M>q T and V G K^o"- As already argued 
above, we cannot make any assumption on the rationality/encoding length 
of the coefficients of U and V. But what we can do is to bound their absolute 
values. 

Observe that if we simultaneously scale a column £ of U by A > and 
row £ of V by t, then the matrix product UV stays invariant. Thus we may 
scale the rows and columns such that \\U ||oo = Halloo (if U = 0, then we 
can just set Vt := as well). We call such pairs of matrices normalized. 

Lemma 2. For normalized matrices, one has ||{7||oo < A and ||V||oo < A. 

Proof. Assume for the sake of contradiction that Uu > A. Thus [|V£[|oo > A, 
hence there must be an entry Vij > A. Then = Ui ■ V 3 > Uu ■ Vij > 
A 2 > (n + 1) A, which is a contradiction. □ 
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Recalling Theorem[TJ we can write conv(X) = {x G M n | 3y G ]^^ conv (^")) ■ 
j4x + C/y = 6}. Our main technical ingredient is to select a linear indepen- 
dent subsystem Ax + Uy = b of ^4x + Uy = b such that the entries of U can 
be rounded to rational numbers with small encoding length and still i£l 
iff Ax + Uy ~ b for some y. 

Theorem 3. For any non-empty X C {0, l} n , there are matrices A G 
Z (n+r)x« ^ G (_l_ Z > )(n+r)xr andavector b £ with pjU, ||6]|oo, 1 1 C7 1 1 oo < 

A such that 

X = {x G {0, 1}" | By G [0, Af : \\Ax + Uy- b^ < jt^— 
{ 4(n + r) 

Here is r := xc(conv(X)) and A := A(n) := (\/n + l) n+1 . 

Proof. Let X = {a?!, . . . , x v } and let Ax < b with yl G Z^ xn and 6 G lJ 
be a non-redundant description of conv(X) with H^Hqo, ||6||oo < A. Further- 
more let S G z{,q'^' be the corresponding slack matrix. By Yannakakis' 
Theorem [TJ we can write P = conv(X) = {x G M n | 3y G E r : j4x + Uy = 
b, y > 0} where f7, V are the non-negative factorization of the slack-matrix, 
i.e. S = UV. By Lemma |2] we may assume that ||J7||oo, ||V||oo < A. Let 
W = span({(Ai , Ui) \ i = 1,...,/}) be the span of the constraint matrix 
of the system Ax + Uy = b and let k = dim(W) be its dimension. Choose 
I Q {lj •••>/} °f s i ze 1-^1 = k such that vol({(Aj, Ui) \ i G /}) is maximized. 
Recall that Ui is the matrix U, restricted to the rows in I. Let Uj be the 
matrix Uj where coefficients are rounded down to the nearest multiple of 
. ? \ r . . Our choice will be A := At, U := U\, b := bj, hence it remains to 
show that 

X = {x G {0, 1}™ | By G [0, Af : \\Ajx + U\y - 6 7 ||oo < 1 | =: K 
[ 4(n + rj J 

Claim. IC7. 



Proof of claim. Consider a vector Xj G X. Using Yannakakis' Theorem [TJ 
we can simply choose y := V 3 > and have Axj + U ■ y = b. Due to 
normalization, \\y\\oo < Halloo < A. Note that \\U - U'\\oo < 4r ( n ]_ r )A • B y 
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the triangle inequality 



\\A lXj + U' I y-b I \\ 00 < || A z xj + Uiy - &j+(C/J - L/»y|| c 

1 



=o 

< r • ||C/j - Ui\\oo ■ \\y\\oo < 



4(n + r) 

<A 



— 4r(n + r)A 

Thus € y. 
Claim. IDY. 

Proo/ o/ claim. We show that for x G {0, l} n with x X one has x ^ Y. 
Since x ^ X, there must be a row £ with A^x > 6^. Since A, b and x are 
integral, one even has Agx > bg + 1. Unfortunately £ is in general not among 
the selected constraints /. But there are unique coefficients A G M fc such that 
we can express constraint A^x + U^y = b^ as a linear combination of those 
in /, i.e. 

(A e ,U e )=Y,*i {Ai,Ui). 
iei 

Note that automatically we have Yliei ^» = ^> smce otherwise the system 
Ax + Uy = b could not have any solution (x, y) at all and X = 0. The next 
step is to bound the coefficients \. Here we recall that by Cramer's rule 

|A , = vol({(^,^)K€AWUffl}) < j 
1 tl " vol({(^,^) | »'€/}) 

since we picked / such that vol({(Aj/, Z7^/) | i' G /}) is maximized. Fix an 
arbitrary y G [0, A] r , then 

1 < \A t x-b t + U t y \ = \^\i{A iX -bi + U iy ) (1) 
>T~ >o ieI 

< ^2 \M '\ A i X + Uiy\ 

< (n + r) ■ \\Ajx- bi + U I y\\ OQ 

using the triangle inequality and the fact that |/| < n + r. Again making 
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use of the triangle inequality yields 



WAjx-^ + UjyWoo = \\A I x-b I + U' J y+(Ui-U' I )y\\ O0 (2) 
< \\A IX - hi + U'fyWoo +r-\\U T - U'jWoo ■ \\y\ 



< \\A I x-b I + U' I y\\ 00 + 



— 4r(n + r) A 

1 



oo iiy moo 
<A 



4(n + r) 



Combining © and © gives \\A lX - 6/ + E/£j/||oo > ^ - > 

and consequently x ^ y. 

The assertion of the Theorem follows. Note that by padding empty rows, 
we can ensure that A, U, b have exactly n + r rows. □ 

Theorem 4. For any n £ N, there exists a set X C {0, l} n such that 
xc(conv(X)) > 0(2 n / 2 /v /nl °g( 2n ))- 

Proof. Let i? := i?(n) be the maximum value of xc(conv(X)) over all X C 
{0, l} n . In the following, we use that R < 2 n (otherwise, there is nothing 
to show) . The construction in Theorem [3] implicitly defines a function <I> 
which maps a set X to a system (A, U, The important observation is 
that due to Theorem [3l for a given system (A,U,b), one can reconstruct the 
corresponding set X. In other words, the function <I> is injective. In fact, 
adding zero rows and columns to those matrices does not change the claim, 
hence we may assume that A is an (n+i?) x n matrix and U is an (n + R) x R 
matrix. Every entry in U has absolute value at most A and is a multiple 
of A , \ for some r S f 1, . . . ,R\. In other words, the domain for each 

entry contains at most Y^=\ 2 ' 4r ( n + r ) A ' A < 8i? 2 (n + .R 2 )A < 16A 5 
many possible values (here we use the generous estimates R < 2 n < A and 
n < A). By injectivity of <3>, the number of sets X (which is 2 2 " — 1) cannot 
be larger than the number of systems (A, U, b). Thus 



log(2n)i? 2 ) 



for some constant C > 0. Hence R > C ■ 2 n / 2 /y / ralog(2n) for some C" > 
0. v □ 



3 The initial system Aa; < b describing conv(X) might not be unique, as well as index 
set /. For $ to be well denned one can make an arbitrary canonical choice, like choosing 
Ax < b and / lexicographical minimal. 
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5 A lower bound for matroid polytopes 

The main drawback of our result is that it does not rule out compact for- 
mulations for any explicitly known polytope. However, we can extend the 
result to matroid polytopes. Recall that a pair ([n],X) is called a ma- 
troid with ground set [n] = {l,...,n} and independent sets X C 2^, if 
(I) I G X, J C I => J G X and (II) for all I, J el with \I\ < \ J\ there 
is a z 6 J\I with I + z G X. Note that all non-trivial facet-defining in- 
equalities for conv(x(X)) are of the form ^ie,s x « — r z(S) with S C [n], 
where rj denotes the ran/c function of the matroid (x(X) denotes the set of 
characteristic vectors of X). Secondly, any linear objective function can be 
optimized over conv(x(X)) using the greedy algorithm, which involves calling 
a membership oracle a polynomial number of times. See e.g. the textbook 
of Schrijver SchO.Y for more details. 

Nevertheless, it is well known that the number of matroids with ground 
set {1, . . . , n} is at least 2^"/^ /{2n) > 2 2n /(i0n 3/2 ) for n large enough |Duk03| . 
In other words, there are doubly-exponentially many matroids. Using the 
same proof as for Theorem U we obtain: 

Corollary 5. There exists a family M n = ({1, . . . , n},X n ) of matroids such 
that xc(conv( X (l n ))) = n(2 n / 2 /(n 5 ^ log(2n))). 

6 Approximating 0/1 polytopes 

In this section, we want to extend the result of Theorem [3] such that any 
0/1 polytope P can be arbitrarily well approximated as a projection of a 
polytope Q with 0(n + xc(P)) facets but still small encoding length. See 
Figure [6] for an illustration. In the following, for any e > 0, let P + e = 

{x + z G R n | x G P, \\z\\ 2 < e}. 

Theorem 6. For any non-empty 0/1 polytope P = conv(X) (X C {0, l} n ) 
and any e > 0, there exists a polytope Q = {(x,y) el"x M xc ( p ) | Bx+Cy < 

d} such that B G Q^P^ntx^ C £ Q(4xc(P)+2n)xxc(P) and b g Q4xc(P)+2n 

nave encoding length poly(n, xc(P), log(j)) and P C proj x (Q) C P + e. 

Furthermore for any objective function c G W 1 , max{c T x | x G proj x (Q)} — 
max{c T 3; | x G P} < e ■ ||c||2- 

Proof. Again let P = {x G M n | Ax < b} be a non-redundant inequality 
description of P such that A and 6 have entries from {— A, . . . , A}. Abbre- 
viate r := xc(P). We again apply Theorem [3] to obtain a system Aj, Uj,bi. 
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P + e proj^Q) 



Figure 1: Visualization of Theorem [6j 



But this time, we round the entries in the matrix Ui down to the nearest 
multiple of 4r(n j_ r)A (instead of 4r(ra + r)A ), for 6 := minj ^^ , ^^r}. 
We choose 

Q:= Ux,y) | WMx + U'jy-hU < 6 ye[0,A] r \ 
{ 4(n + r) J 

Note that Q is in fact a polytope which can be written in the form Q = 
{(x, y) | Bx + Cy < d} such that B, C, d are of the claimed format. Further- 
more the encoding length of B, C, d is polynomial in n, xc(P) and log(l/ejl|. 
In the remaining proof we show that P C proj x ((5) Q {x 6 M n \ Ax < 
b + 51} C P + e. 

Claim. P C proj x (Q). 



Proof of claim. As in Theorem [3l for any vertex Xj 6 P, one has (xj, V 3 ) G 
Q (since H^/ay + U'jV^ - 6 z ||oo < r • ||E/J - C//|U ■ ll^'IU < 4^). Conse- 
quently P C proj a .(Q). 

4 This follows from the fact that all coefficients in B, C, d are products of n, xc(P), <5, e, A 
(or their reciprocals) and log(A) < 0(n ■ logn), log(l/5) < log(l/e) + 0(n 2 logn). 
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Claim. proj x (Q) C {x £ R n \ Ax < b + 51}. 

Proof of claim. Suppose for the sake of contradiction, that there is an 
x* £ proj a ,(Q) such that for some I one has A^x* > bt + 5. Revisiting again 
Inequalities ([1]) and ([2]), we see that for any y £ [0, A] r now 



5 < (n + r)'\\Aix* -bj + U^loo 

© / \ 

< (n + r)- \^\A IX * -b I + U' I y\\ 00 + r-\\U^U^-\\y\\ 00 j 

<5/(4r(n+r)A) <A 

< (n + r)-\\A I x*-b I + U' I y\\ 00 + ^ 

which implies that \\Aix* - b T + Ujy\\oo > ^ - 4(n +. r) > 4r (^ +r) and 
consequently x* ^ proj^Q). This is a contradiction. 

Claim, {x £ M n | Ax < b + 51} C P + e. 

Proof of claim. It suffices to prove that every vertex x* of {x \ Ax < & + <51} 
has a distance of at most e to P. There is a subsystem Ajrc < bj + 51 of 
n constraints such that x* is the unique solution of Ajx = bj + 51 or in 
other words x* = Aj (b + 51). Since A has integral entries with absolute 
value at most A, we know that we can write Aj 1 = with (Xij,f3 £ 

{-(nA) n ,...,(nA) n fl 

Let us assume for the sake of contradiction that J was not a feasible basis 
for P, i.e. A(Aj bj) ^ b. Well, then there is an index i with A^A^bj) > b{. 
In fact, even Ai(Aj l bj) > bi + i. But since we picked <5 small enough, 

- Ai{Afbj)\ = \AiA-j l 51\ < n 2 • A • (nA)™<5 < ^ < ± which is a 
contradiction. 

Hence we may assume that J is indeed a feasible basis for P and we can 
bound the distance of x* to P by the distance that the basic solution corre- 
sponding to basis J "moved" by shifting the hyperplanes by 5 (see Figure [2]): 

\\x* - Afbjh = \\Aj\bj + 51) - Afbjh = WAj^lh <n-5- (An) n < e. 

Here we again used our choice of 5. 

Combining the proven claims yields P C proj x (Q) C P + e. □ 

5 By Cramer's rule, every entry of the inverse of an n x n matrix M can be 

written as ± d ^t(M) ^ or some submatrix M' of M. By the Hadamard bound, | det(M)| < 

rnu \w% < e (niiMiur. 
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g J 



x* = A~ 



Figure 2: We bound the distance of x* to P by the distance to Aj bj (see 
dashed line). 

7 Complexity theory considerations 

The set of problems that admit compact formulations induce a non-uniform 
complexity class in a natural way. In the following, we want to briefly dis- 
cuss, how this class relates to other, well studied classes. For an up-to-date 
introduction into the topic of complexity theory, we recommend the text- 
book of |AB09j . Recall that {0, 1}* = U n>0 {0, l} n is the set of all binary 
strings. By a slight abuse of notation we consider a 0/1 string of length n 
also as a binary vector of dimension n. 

Definition 1. Let CF be the set of languages L C {0, 1}* for which there 

exists a polynomial p such that for all n G N there exist A G RP( n ) xn ) B G 
RP (n)xp(n)^ be RP (n) such that 

conv({x G L : |z| = n}) = {x G R n \ 3y G M p(n) : Ac + £y < b}. 

By CF enc C CF we denote the subclass of languages, for which there exist in- 
tegral matrices A, B and vectorsb such that log(max{|| J 4|| 00 , H^Hoo, ||b||oo}) ^ 
p(n). 

Since any LP of polynomial size and encoding length can be solved in 
polynomial time, it is rather obvious that CF enc C P/ po i y (see also the 
remark of Yannakakis |Yan91J). However, Theorem [3] also provides a slightly 
stronger claim: 



Theorem 7. CF C P 



/poly 
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Proof. Let L G CF and X = L n {0, l} n for some n G N and let r : = 
xc(conv(X)). Recall that r must be polynomial in n. It suffices to provide a 
Turing machine that takes polynomial advice (see |A"B09j). Our advice for 
all input strings x of length n consists in the matrices A, U, b provided by 
Theorem Note that their encoding length is bounded by a polynomial in 
n and r. To verify whether x G X, we simply test whether the following 
polynomial size linear system has a solution y: 

' < Ax + Uy -b < ' 



Ar{n + r) Ar(n + r) 

0<Vj < A Vj = l,...,r 

This can be done in polynomial time [Kha79]. □ 

We make the following conjecture: 

Conjecture 8. CF enc = CF. 

One of the most popular polytopes in the literature is the TSP poly- 
tope (see e.g. [Yan9U [ BS96] ), hence we want to discuss how it relates to the 
class CF. Let K n be the complete undirected graph on n nodes. We define 
a language 

TSP = (J {x(C) € \CCE n ]s Hamiltonian cycle in K n = ([n],E n )} 

(here denotes the characteristic vector of C). Again it is obvious that 

NP %. P/poly => TSP 4- CF enc , but also here we can show a slightly stronger 
claim: 



Theorem 9. NP % P/ po i y => TSP & CF In ot ^er words, unless NP 
problems do not all have polynomial size circuits, the TSP polytope does 
not have a compact formulation, even if arbitrary real numbers are allowed. 

Proof. Suppose for the sake of contradiction that TSP G CF. By NP- 
hardness of the Hamiltonian Cycle problem |GJ79] . given a cost vector c G 
{1, 2}( 2 ) it is NP-hard to decide, whether there is an x G TSP with c T x < n. 
Consider the Turing machine (taking polynomial advice), which optimizes c 
over the polytope Q from Theorem [6] for e := 4- and let x* be an optimum 
fractional solution. If there is an x G TSP with c T x < n, then c T x* < n. 
Otherwise, c T x* > (n + 1) — e[|c[|2 > n. Hence the Turing machine decides 
an NP-hard problem, which implies the claim. □ 



13 



Note that TSP G P/ po ly7 since testing whether x is the characteristic 
vector of a Hamiltonian cycle is easy. Just optimizing over all those vectors 
is difficult. 

We should not introduce a new complexity class CF, without relating it 
to already known ones. We saw already that CF C P/ po i y , so what about 
other non-uniform complexity classes within P/ po i y ? Certainly the most 
studied of those classes is AC , which is the set of languages for which there 
are circuits with bounded depth and unbounded fan-in. 

Recall that PARITY is the set of all x G {0, 1}* such \\x\\i is odd. Then 
PARITY admits a compact formulation (with small integral coefficients; see 
e.g. [CCZ10] ). thus PARITY G CF enc . In a seminal result, Furst, Saxe and 
Sipser |FSS84] showed that PARITY £ AC and hence CF % AC (in fact, 
even CF enc % AC ). On the other hand, under widely believed assumptions 
also the reverse is true: 

Theorem 10. NP % P/ po iy AC % CF. 

Proof. We need to exhibit a problem, which can be solved by constant depth 
circuits, but is likely not to be in CF. Consider the complete tripartite 
graph G n = ([n] 3 ,E n ), i.e. for any distinct i,j,k G [n], one has a triple 
e = {hjjk} G E n . We say that a subset E' C E n is a (3- dimensional) 
matching if all triples in E 1 are disjoint. Define 

3DM = |J {x(E') | E' C E n is matching} 

n>l 

Given a cost vector c G {0, l} En , it is NP-hard to decide, whether there is an 
x G 3DM with c T x = n |GJ79j (i.e. whether there is a perfect 3-dimensional 
matching contained in {e G E | c e = 1}). Within the same line of arguments 
as in Theorem [9] one has 3DM ^ CF unless NP C P/ po i y . Finally it is not 
difficult to see that 

f\ (-.x e V-.x e /) 

e,e'G-B:l<|ene'|<2 

is a polynomial size, constant depth formula for 3DM, thus 3DM G AC . □ 
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